
BEST AVAILABLE COPY 

Application No. 1997-0024562 
Laid-open No. 1999-0001299 



Abstract 



The present invention relates to a method for 
operating an unmanned surveillance plane system; and more 
particularly to a method for operating an unmanned 
surveillance plane system by using augmented reality 
technique, which supplements real-world information with 
the use of virtual reality. This method operating the 
unmanned surveillance plane system of the present invention 
comprises the steps of: a) collecting information on the 
object to scout by photographing and obtaining real picture 
images of the object, and visualizing necessary information 
with computer graphics and visualization skill to generate 
virtual reality; b) obtaining absolute position and real 
picture images of the object of surveillance with the use 
of the GPS and CCD cameras, and combining the real picture 
images with the virtual images generated from the previous 
step a); c) synchronizing the virtual images with the real 
picture images that change as the unmanned surveillance 
plane system moves through user interface. This inventions 
makes it possible to use information efficiently as well as 
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Ai^iiM ggmfe CH&»^ ^Af oloiiis mm Q^m m'^o\o\ ai^^oii mm gee ^^Sofn oi 

□ixie ^^of:?i ^oH g^a ziaijs"^ :»(^ :?^Ala^ o\^o\o\ gsg :?uis} m\ i 3}gi>f. gpss^ ccd ^\m^}m o\mo\ 

01 gi^ CH^^^j ^^CH mXlSt^ ^MO\Q\X\m ^'Zfl M\ 1 BgCHlAI D}^ OlOIXISf ^'A} 0|D|X|# sv^s^^ 2 3fg3}. AfgX} eieifllOl 

±m mm ^21 M±ms\ oieoii ^o\^ oioixisf oioixi# m 3 jug^^ ^^sjoi. gsM sM^^ 

^ Oiei^ 4^ 2^201. si^g gOloM! ^*2^AH gs OIgM 4^:?^ £iP. 
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m ^ Mm (20%) 



S100 



GPS gg- ^ 



S200 
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£ 1^ e ^'Sdi lit s^' j\mm o\mm ^sj §^*:,| zp^^. 

£ 3S S ^►SOil CDE giJ 3Hg£. 

£ 4fe S SSOII CDS &g §e 4.<M §x| 3HgE. 

£ 6S S ^►gOII mm 9f(Hiei ?JxI2S(GPS) 3Ha£. 
£ 7g S &»S011 (Dg XJOISOtDiia SS3g) 3Hg£. 
£ 8S S a^gOil (Dg ^M2i ?ffe'OIOIXI s'SOil CHsl HeiSSs, 
2000/10/12 ■ 



S300 



£ 12^ E ^'soii (DE oloiii eM2i e^oii xhbis. 

£ 15b E ^^SOil £GE OlOIXI 2M°I §^011 X^a!£, 
£ 168 ^ ^^gOII COE gSCMap) DB E^'OW CHsV xHdl£. 

100 : GPS ^^0000200 : :>\X\^ 

201 : g^a(PC)ooo202 : Eil^^g Map D/B 

203 : TNCooooo204 : 1 4=>j:?l(RX) 

205 : M 2 ^4^^D\{TX, RX)oo300 : ^:'! 

301 : mOI §S[ 5f0ilB|ooo302 : QIOIEH §X|(TX) 

303 : J\0\^ A|^gjooo304 : GPS 

305 : o^alUoooo306 : XFOI^eH^i 

307 : XfOI^Ell^M 



^21 ^m^i M^moi^ eenoii Af^oi S¥M ^^lysts oi^af^ ai^ijo^ai. s<m ^ g^E-i ziehs^ esj ^^^^ 

^El ZieH^^ :?I^IJf. g^EI dl2 ZldlH m^X-{E\ ^ ^^m^ GIS (Geometric Information System) QIOlEi G 

PS(Global Positioning System) ^' :?l^0| gllEJI) 9JiQ. 

01 (Dl, ^^'(Augmented Reality) J\^6\^ ^Mmm Q\m OjoHeSIOIl ^ sie ^PH9 :?I^S>M. OlIM g^. Xf^xf LH^ qi2E0il CHoH 

xjsxfe ^=Aii ^xiioii □^£^ oioHM'^oib :?i^oip. 
^01 go^2i 2^ et^sfb Pi^oi Dm^^^m, :)[^^ m^m oilmen ^'ah^i §sm ei^oj^ ^^^^m ^M\:nm 

ojaniioi:^ ^E: ^^hi q.± o\^o\\ am 2^ :?h^^oi Ai^^asiu. 



mE}M. ^ ^^o\\M^ MBJ} 2iBm\oi:^2^ ^Mz^ gee -^^^^ ^ 91^ Jimm o\Em ^m^i M^ms^ ^mm^m 

^D\2\ ?|oH s «^goilAl JHlgoJb ^ot A|r^g£| gg^^gB Qi&^SJ ^'M OlOjXIM ?I5H §1? Di^^e CCD ( 

Computer-Controlled Display) ^fOiiei^ m^o\(n CH^'Oil Oiel ^^o\ll. OlOIXjg ^^of:»| ^6H m^E\ ^ 

:)}Mm O\md\0\ WQm see D\Mm M \ BSSf. GPS(Global Positioning system)^ OieajOi §if ?lxl2f H ?l 

xioiiAi oii:^ ^OFei^Hj ^smii 2ifeiHoii §SM ^01 ^^:/! ;yi i 3}goii/H ^se! 0101x12^ oioixig i/^6f 

b HI 2 MgX} oiEICilOj^e eoH 4^:'! §^Ot Al^gi°] OjgOil 0Q£} ^sfb ^'Al OlOIXiSf OlDIXIg e:?l§f 5}^ HI 3 3[§ 
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x-iej oesom. s 3^ ^ irgoii cue ini^ ^h^soiii. s 4^ s ^^goii (de ^§ >.ai §xi :?h^eoiji ss^'^^^vo.Qjf 

^'G{\ al^^ xHaiEom. E 12^ ^ ^^sci! mm oioixi ii^ e^oj §^oii xnaiEom. e 13^ ^ «.goii omixi xnaTs^oi" 

B^m Q{m xHaiEom. E 14^ B m^ow mm oidixi sHdi smsi §5,^011 c^^o^ jtidiEoizi. e 15^ b ^^soii ede oiqui "^h 

2§2i e^^Oii CHei x-idlEOIia. E 16^ ^ W^OW COE ?S(Map) DB S^2J e^Oll CHs^ x]£|EOID. 

E 1M ^(^g Oleo^ °oi g^pi Al^l.'^ CCD 5fOil£l. aiOlH ^<M Sxl(TX.RX). X^OI^ ^ 3KHI£f ?lxl S# ^ 

<JLO|{GPS)g eiHe^ i^^l(300)7^ 24:>H°I BmE} mx\ Sg(GPS) ?j^(100) ^ ^IXI^(200)3[ S<Mg 5^£^ SiQ 01 (Dl :^ixi^ 

(200)^ Jl\±^ g^a(201). Elir^r^g gS(Map) QIOI EimiOI^(DB:Data Base)(202). HOI^ EE lilOi:* I (TNG Terminal Node Controller)(2037 

^4^6i:'i(204. 205):^F ^^^^acH 910. 

^:^\9^ ^B =?^m B m^s} ^01 g^.:), ai>i^'^ ^^^i h:' 1(300)011^1 ceo Bm^}^ ^'Afs^^^f gps mgm^ ?ixi § 

^^^^y sxi(Tx,RX)s saH ^timji, oim §se ^^^<y:^i(204)M eoH :?ix!^oiiAi 4^<^ll6^01 ^:)\ B\±mm ^ db(202) §s2f ^'m m 
±M g^a(pc)(20i)s oigoH x-idi^i §sm bmqw m^m ci^Maioi ma. nen^. ^^Ei(pc)(20i) A^gxt^ 3 §y^o\\ 

L}E}y ^ix\ii lii^m ^mmo. 



-ill 



0)1 CHe[ ^XH #SX|011 CHdH 0101 CilOIEHlf SOi □ Xlg ^' SgOlU E^°j bHxl &^EH g2J gSM HiJOlU ^ 

xf^ s^sj oiDixis g^a n^^m^ J\m ^ D\Mm m^m oigmoi m^m §se oti3(sioo) gpsm o\bb\o\ 

mm a\^^ ma\ mx\s} n ^xiowm o^E ^m^^ ^u\^msi g^is mrno^n si^xioii cHsf §sm ^oi ijuisi 2f§(sioo)oim 
e 0101X12^ ^Aj oioixiM m^m miszoo), A^gx^ eiaiHioi^M mm ^21 ^m^i ai^ijoj oieoii m^^ ^'m 0101x12^ d\ 
^ oioixia §:?is}(S300)eia. 

01 m, M±ms^ dieg #s ^' Bf§(sioo)oi 2o%oii2. gps ^ ^a\2\ omixi^j 2fg(s2oo)3i ^gx^ ejEiffiioi::^ 

m mm ^ms\ oioixi ^D\m 3i§(S30o)oi 4o%oicf. 

E Sm m^o\^. B rn^OW mm mtlS IH^y ^^H(PC:Personal Computer)(201)2f BUlW EE JtllOi :?l (TNC)(203)£f . ^^A|dl(203') 
Oil HjoH OI^OiSlD. 01 OH. EiOl^ EE HIOi:?l(TNC)(203)b AFSK( ******* Full Name ******* ) e^(OUT)3[ PPT( ******* Full Name * 

****** ) esH ^<^j6fii. r^^xi sms^ ^'^(audio in) a^s mm ^^Ell^o^l e^Aitfi(203')fe mic( ***** 

** Full Name ******* )£f ppj ANT Rig( ******* Full Name ******* ) SMg 4=<!i]ofII. r^^^xISf AF OUT(SP)( ******* Full Name ***** 
** ) mm ^M^'^^m ElOiy EE X-ilOi:'|(TNC)(203)2f. ^e^^A|bH(203')Z^ m^0\ Q\^0\BO. 

01 [Ql. 1^01 IH:^^^ ^Sa(PC)(201)£f ElOl^ EE HI a]:?|(TNC)(203)^ RS-232Ce g6H e<5JM 



E ^^asmS. = E^SOll [EfE #S li:?l 5tDil£K301)e geH 4^iJ£|^ClI, 4--<i'S ^:?IOil ¥^^E1 GIIOIEI 

S^xi(302)M mm :?l XI ^(200)011 ^SfSj Xll 1 4^Ai:»|(GS-550GTH)(204)^ 2^3:2, BOI^ EE X-llOl (TNC)(203)* :>ixi ^iJEiSf C|±H^ 
UIXHe^ ffl^y gSEl(201)^ RS-232CS goH S1^€IP. 



E 5M if^Sf^. ^ ^^SOlt PE m^'S\ ^Ais g^Ol ^s,^ ?f01i£f(301):?[ g^g qioieh § xI(GS-1 20R)(302)M goH :?IXI^(200) 

LH2i Xll 1 4-<i!:?l(GS-550GTH)(204)^ m^. &0| XII 1 ^tilD\{204)^ S^MTV)2f GIOlEi^ <i^go^^ m±*^ g ^&i(PC)(201 )^ 

E em ^'^o\^, B mm B\mE}2\ ^xlSC-(GPS)e e^aiU (Antenna) (305) S mm m?\(300) U\S\ gps 4=i!ii:'l(304)^ 2 

PAI ^^Aim^ 2^£I0] S<y^ ^oH :?1X|^(200)UISJ EiOl^ EE Xll Oi:?|(TNC)(203)^ ^<:ii3D1. ^:}\ EiOiy EE 

XllOi:)|(TNC)(203)^ 4^^^ §eb RS-232C0II HJoH g^Ei(PC)(201)^ 5!^^r|. 

E 7m ^'^o\^, B %'^0\\ mm B\m^ ^^l.^S^(X}0|S)S, EHX^. XfOIS 2ii5!(Gyro Engine)(306)Eg¥Ei §SM ^^OF XtOIS SAf 

^ (Gyro Test box)(307)^ o\m xFoi^ 3A^ a[^(307)^ xioi^ ^a\e1 ^^M^m mm pixi^(2oo 

)LH£j EiDI^ EE XilOi:f|{TNC)(203)^ 2^6fI2. §SM RS-232Ce goH m±^ g ^ EH (PC) (200^ ^<^J£.^cf. 0I2[ ji^gs 

>1xl2. ^^:?| 9f01!£K3Ol)01l ^^^mO\ OI¥O^SP. 

E ^^2o^^. B m^o{\ mm ma\2^ :?f^»oiDixi m^m xiai^ enx-i. ^foiiai^s ^ ^A\<^^m m^o\ii{s20]), ^\m^\ ^x\^m(GP 
s)^^E\ 9\x\m^m aj^(s202)moi. mmm 9\x\ sesf d\m^^\ ^M^^m 6h^(S203)£| m, ^oi sh^ei §se oigojoi 

gas ::'UIIf(S204) 31 Qg. ^Ol 5H^^ ^El ^A\0\0\X\2} :7F^^OI0IXIM i^^(S205)^^□. 

E 91 ^^^ois. B m^QW mm ^'A}£f :?j&^oioixi mj\m x^E.\^ six-i, 9joiidf§s ^ ma\^^ §sm i^^oHj(s3oi). ^foiiaf ?ixis^(gp 

S)^¥E12J ^XlgSM ^^oHI(S302). ^sfSeiOl] CHei §SM aJ ^(S303)§[ P. Z1£|I2. ^:?| §321 ^Xl2f I^KM ^?I01I CH£^ ^At 

gss oH^(S304)e[ ^. m^m ^A\ ^sfQeioii mm a§ seie 5H^(S305)m:ii. m^^ §sm oigai :?f&^ ss-i d\a\ 
oi(s306)£^p. 5jg5io^ Av:,( A.A^olOlXl2^ :^^^>0lDlX|g i^^{S307)otoi §e°j xiz\mo. 

E lOg s[5orS. B ^^soii mm ^21 mmD\ ai^s^i ^ h^zi^^ oidixi t^s 2§(io)oi:a. oioixi s^(io)^ omixi 
dl s#(20)iif 4'Af oioixi xidi s§(30)^ ^^£ioi. ^»:^i 2| ^Ei omixisf ^ai oioiiim m^mo. 

E£.K oioixi X-iai EM(20)^ oioixi EM(40)2} °S DB SM(50)^ ^^aOi OIM Q4i^(40, 50)011 ei6H 

oloixii xiaiofoi. &OI OIOIXI xidi 2^(30)^ CCD 3joiiei xiioi Qmaom GPS ^ xfoi^ jgioi 2§(80)^ =?^s\o\ o\m 

Q±mi70. 80)011 2J5H ^0i2 ^'Af OlOIXIS XiaielQ. 
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"£ if^a^s. ^ ^oi g^:,! ai^^^sj ^ e^oii mm ^di^ sixi. gis^cwindow'^^^e ^§(i)aFJ} omixi °§ oIo^o^l 

2^(0101X1 i^S Qmm ^mo\0\ x-\^\mO. v^veno^ ^ 

£ i2g gr^ms. B ^^goii CDE OIOIXI i,^^ eM£i e^oii ^-idi^ ccd smE}^ gps j^oi^ ^-ai:)| ^ 21 «^ xj^.o. 

OIOIXI x-idi eM3} ^'M OIOIXI Xi£| em)M mm^^3)o\0\ ^MS^ OIOIXIM StHBilOUl^^ ^m{U)A\^Q ZiaiJQ Olia 0l^^(E7ror F°ve 

E 13m if^oF^. B ^^o{\ mm OIOIXI x^^\ ^msi m^'ow aim xnai^ :»ixi^5j ^<m:'i(rx)^ ^^i^ 21^ ^"^e oH>^(2n 

6HAi CCD 3f(Hiei ^^E^ :?tAI (field of view). mO\ ^xl. °J DBS] mm mo\U\Ii. o\9\^mO\^y OIOIXI SMUf °" 08 ^ 

^ eM)Oil ^Ig(22)cFW. SM^ ¥6i 0101 X|2f °» OB GlIOIQS ^mO^^^ OIOIXI x-idi 2M)01I ^^E(23) ^' ^^i 

2 14M ^^55ts. s ^^o{\ mm 0101X1 xHai e^si ^^^oii cnth xnai^ ceo 3\o\\e}, gps xjoi^ ^--ti^i m 

x\2\ ^am mm(3\)o\:n n ccd ^toiiafoii s^m m^B oidixis m^ii ^mm mm 2^(0101x1 2^)011 a^ei^r 

32). 0\Zim 0I01XI2J 2M0il ^^gJC:K33). 

2 15M ^'^o\^, B ^^SOil CD^ OIOIXI 2MSJ e^^Oil ai£^ xiai^ Alg (position), ^^«^(vlewing direction). ^UiS^(field of view 
) m ^i.^Xf §S(parameter)e ^g(41)oH}. xH£IE^ ^ o,^^ ^mJ}B\ ^RxWMeye coordinate)^ §S ?lxie UF^^(42) 

Al gsOOIXI □ XIS)^ Xll>1(43)ef ^ 9UI S^LH ^ai^ 9lJ\\ (rendering) (44)3^01 ^^§1 oiGIXIM 

2^(0101X1 2^)011 Hlge-^Q- 

2 \sm ^'^Bm, B mm gS(Map) DB 2M£] e^^Oil Q\m xiai^ 2 1321 ^^01 mmXi §S(parameter)M o]{^o\0\ J\M S^LH 

^ m^m ^^:n(5i). u\j\a\ g« ga^ :qi>i(52)ef ^. :?ui s^oii 91^ ou g^oj Ahoj 2§(oioixt 1^^)011 z^ig(53)tiD. 

§aiS H 1011 UEfUISiD. 



[S 1] 



"'^•AllXlSf 



mm m 

® ^Aii^ii §a2j y\A\m 



I 



©TO'SToToixiS'^ra" 

Aii:*ll OIOIXIHI 1,^^ 

© :?fAiif§ ^mo{\ mm 

M\7\\ OIO|X|2f°l 

^1.^ Dm 



M\D\\ 01 01 XI °| 
€i ^'Ali:?j|2f AMIS] 

e:?isf ■ 



-3cr2WS"":?Tff 

- :'f^^ m^ Dim 

- §s ::'tAisf :?i^ 



- omixi xnat Dim 

- ^ixi oiAi 

- Overlay S^:?h 

- Display Scope 
I^l^ 



- ¥1x1 ^ ^^1^ 01 XI ^' 
XHEPI^ 

- Sfe^ Overlay xH £| D\m 

- ^sf S§ D\m 

- Scaleable Font xHdl D\% 

- Display Scope x^^\ D\g 

- mD\m Dim 



s ^m ^'^o[^. B D[^ M\D\i Rm D\m =?mm d\^ s^^^a ^^o\ii, ^m\d\\ gs^i D\Mm Rm ^^m :?h^^ois^cii 'oim 
^cH 3D 2i'ii D\m, Dim. D\A\m Rm Dim ^ so cixfei :'i^oi A^g£i£iI) ^mid\\9^ Aii^jisi ^i^ D\m 

^M\D\\ oioixi2f D\^y M\D\\ oioixie 1.^^611}. D\A\ ^§foii co^ M\n oiDixi2f£i ^^m Dmm'^^Gii. oim oToixi 

xHdl Dim, ¥1X1 oiA. 3,,^^ 2 tHeil 01 (Overlay) Rsi Dim, xHdl ^ CI^MailOl ^3H(Display Scope) RB Dimoi A^gS2iP 
^'Ail?jl2f :'l^^ AlMlSfoj g:?,^ ip^^ 0,^1, ^^21 :jjaj 5^501 ^j^^ MMID\12} D\^ MID\19\ 2^5i{M BDl^ ^ ^Ml 

D\i9} Hm mDimm ^mo\^^Qi. oim mm mti/^^ 01 ^i ^> xnai Dim. 2 tneii 01 (overlay) xiet Dim, mm s§ :?i^ 

. 3:^1 ::)l^sj ^e^caleable Font) xHdl Dim, C|>:Sail0I ^3H(Display Scope) X^^l Dim ^ ^Dls} DimOl A^gaSiQ. 



Aoisf B m^s^ ^^m omm ^2i^mDi Ai±ms\ m^^^s ?}^2\ ee^^f g^£i£j mm ^ilk n^in m^i^ 

biM^'^ esj ^mmm mm ^mm s2^ai. §se ^^^12^ oig^^ ^ 2^201. §3 li^e goio^^i m^^M §s oige ^d\ 2. 

(57) ^^^£i 

e?:^ :? I ^(Augmented Realily)^ Ojgst oot Al^giOll ^0\M. 
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n{^B\ MM omx\m mm q^.m m^B\cn a^m aei gse ^^mn t^xioii choh oioi m\Bm □ 

^^se oigojoi ^JH £^i32i^ ^s.2ie o\m, 2g ^oi. bs^j--^^ oie e ^s^^ gss ^iaii^ jqm 

GPSM OlgoJW Ql^^oj ma mx\2k □ ?lx|Oi|Ai Oii= g>^EKviewing directlon)o ^ ^Oio^eoj go^^jj^,^ of view) M ^SofH oi^xiOi) 
□ §Sg ^Oi ^1 1 3f§01iAi OIO|X|2t OlOIZlg 5| BR nmP\^ OlOIXI 5fH Xl!:*li2} OIOIXI 5fn jyi^n^ s 

^^0\ OmiXI etnaiOKimage overlay) m^o\^ M 2 ^ ° 

AjeX} ojEiiHIOI>.e gSH ^o, A|:^g,'2| Olgt^Oil ^ x| (position). ^^i^Kviewing direction). ^Ulg«(field of view) 4' 

Aj o\D\x\D\ ^o\ii 01 ^119 ^xi. ?\M^^m JiE^sm oiDixiM ^^s\o\ ^ oloixis 2fc«aioiAi?i OIOIXI momm 

0\m^ J3\ 3 ^SHS of^ SOI Al^g-^J 
^^^^^ 2. 

Hi 1 ^^Oil °»OiAi. HI 2 

CCD d\Q\m §e ^ ^'Af OIOIXI □am gps gs^^ej □a^oj §sm ^^oF^ hi i 3^i2f; 

^Ol mi^sf o,^, g^2f J\M^m ^AJgee SH^Sf^ HI 2 &^l2f: 

^oi oH^& §SM oigmoi g£M :?uii}6f^ hi 3 y^lSf: 

^Ol oti^Ei-SS^^a ^'M OlOIXISf OlOIXIS s^^of^ HI 4 B^IP S^^of^ 51^ ^S^^ Sf^ ^2J§&0| Ai:^g2J gg^^S. 
3. 

HI 1 1^011 910\M, HI 3 3fgg 

5K}iie> §s ^'Af OIOIXI. GPSS^Ei ^ixiss Z1&II1 siisojoii m^m^ hi 1 B^ISI: 

&^:ji m^m ^zisf :?fAig?ioji u^t^ ^'A^§sg oH^sf^ hi 2 e^iisf; 
^^:'i m^m ^'msshi ^ifseioii ma s§ seje oH^5^^ hi 3 B^isf: 
^^:'i sH^Ei SMB ojgti §se :?^Al2f6^^ hi 4 e^isf; 

aH^Ei ss2j i^uiiiM m ^ ^'A^oioixisf :»f^^oiDixi°i m^m hi 5 B^\m s^^sf^ m^9.^ 6^b ¥ej§i^::i ai^iihi ^ 
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